CCOBRA Evaluation Results

Benchmark Information
Benchmarkpremiseorder.json
Date2020-04-24 16:43
typeadaption
domainsspatial-relational
response_typesverify
data.test4ps.csv
data.train4ps.csv
data.train_person
corresponding_datatrue
Results
Prediction Accuracy
RandomModelLSTMTransitiveClosureRNNAutoMLMLPPRISMVerbal ReasoningMostFrequentAnswer00.10.20.30.40.50.60.7
Accuracy of Model PredictionsPredictive Accuracy

Predictive accuracies of the benchmark models, i.e., the percentages of correct predictions.

Subject-Based Boxplots
RandomModelLSTMTransitiveClosureRNNAutoMLMLPPRISMVerbal ReasoningMostFrequentAnswer0.40.50.60.70.80.91
RandomModelLSTMTransitiveClosureMLPRNNAutoMLPRISMVerbal ReasoningMostFrequentAnswerSubject Performance BoxplotPredictive Accuracy

This plot depicts boxplots for the models indicating individual subject performance. The data used for the plot are accuracies for individuals. Consequently, min and max refer to the accuracy of the worst and best matching subjects. The dots refer to the mean accuracies of individual participants.

Most-Frequent Answer Comparison

No data encodings available.